Chapter Report
(to be printed in The Language Teacher)
Guest speakers: Christine Winskowski and Susan Duggan |
AKITA - October 2006 "What did you think of the course? - Understanding
Students' Course Evaluations"- Christine Winskowski and Susan Duggan
Professors Winkowski and Duggan began their presentation with some leading
questions: “Do you wonder what students are thinking when they fill out
those end-of-semester course evaluation forms? Ever wondered why someone
picked a 5 instead of a 6? A 4 instead of a 5?” Since the Ministry of Education,
Culture, Sports, Science and Technology mandated the administration of
course evaluation forms in 1996, their use in Japan has sharply risen.
In other countries, use of course evaluation forms is widespread, if still
controversial. Since Japan has newly adopted this approach to teacher evaluation,
they feel it is important to be clear what such instruments tell us, and
what they don't tell us.
The talk first covered the history of the use of this technique for teacher evaluation starting in the 1920s. Then they reviewed the literature on its validity and reliability. Then pointed out how many teachers were required to dumb-down their classes in order to receive a higher evaluation. Next they explained how they decided to find out what students are thinking by interviewing 10 students as they filled out their evaluation forms. Following a recent line of research, they asked students to explain their understanding of the items' interpretation, and the reason for their ratings. While their findings are still at the pilot phase, it is very clear that students interpret items differently from one another, and base their ratings on different criteria (some of which seem only loosely connected to teaching effectiveness). These results reinforce the notion that course evaluation forms are at best low-precision instruments.
After discussing in detail the thought processes of the students and pointing
out the many surprising interpretation they offered, the talk ended with
a lively question and answer period. The teachers in the audience explained
some of their own feelings about these surveys.
Reported by Stephen Shucart |
|